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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 

application: 
Listing of Claims : 

1 . (Currently Amended) A Hierarchical Summary Description Scheme (DS) for 
describing a video summary, the HierarchicalSummary DS comprising: a HighlightLevel DS that 
comprises includes at least one Highlights egment DS, the HighlightSegment DS configured to 
describe information on a highlight segment corresponding to one of a plurality of video summary 
intervals, the HighlightSegment DS further comprising including a VideoSegmentLocator DS 
describing time information or a video itself of the highlight segment and an ImageLocator DS 
describing a representative frame of the highlight segment. 

2. (Previously Presented) The HierarchicalSummary DS of claim 1 wherein 
said HighlightLevel DS further comprises at least one lower level HighlightLevel DS. 

3. -4. (Canceled) 

5. (Currently Amended) The HierarchicalSummary DS of claim t^-i_wherein 
said HighlightSegment DS further comprises a SoundLocator DS that describes the representative 
sound information of said corresponding highlight segment. 

6. -7. (Canceled). 

8. (Currently Amended) The HierarchicalSummary DS of claim 3-i„wherein 
said HighlightSegment DS further comprises an AudioSegmentLocator DS that describes the audio 
segment information constituting an audio summary of said corresponding highlight segment. 



9. (Canceled) 
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10. (Previously Presented) The HierarchicalSummary DS of claim 8 wherein 
the HierarchicalSummary DS includes an attribute of a Summary ComponentList that describes and 
enumerates SummaryComponentTypes representing types of summary. 

11. (Previously Presented) The HierarchicalSummary DS of claim 10 wherein 
said SummaryComponentType comprises keyPrames representing a key frame summary composed 
of representative frames, keyVideoClips representing a key video clip sunmiary composed of key 
video segment' sets, keyEvents representing a sunmiary of a video interval corresponding to either 
an event or a subject, and keyAudioClips representing a key audio clip summary composed of 
representative audio intervals' sets, and an unconstraint representing the type of summary defined 
by users except for said summaries. 

12. (Previously Presented) The HierarchicalSummary DS of claim 1 wherein 
the HierarchicalSummary DS further includes a SummaryThemeList DS enumerating the event or 
subject comprised in the summary and enabling users to execute summarizing and browsing based 
on the event 

13. (Previously Presented) The HierarchicalSummary DS of claim 12 wherein 
the SummaryThemeList DS comprises an arbitrary number of SummaryThemes as elements, and 
the SummaryTheme includes an attribute of and ID representing a corresponding event or subject. 

14. (Previously Presented) The HierarchicalSunmiary DS of claim 13 wherein 
the SummaryTheme further includes an attribute of parentID that describes the ID of the event or 
subject of the upper level. 

15. (Previously Presented) The HierarchicalSummary DS of claim 13 wherein 
the HighlightLevel DS comprises an attribute of themelDs describing an attribute of the ID, when 
the HighlightSegments or HighlightLevels that constitute a corresponding highlight level have 
common events or subjects, the ID of the common events or the subjects is described in the 
themelD. 
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16. (Previously Presented) The Hierarchical Summary DS of claim 13 wherein 
the HighlightSegment DS comprises an attribute of themelDs describing the event or subject of the 
highlight segment using the attribute of ID described in the SummaryThemeList DS. 

17. (Previously Presented) A computer-readable recording medium where a 
HierarchicalSummary DS for describing a video summary is stored therein, wherein the 
HierarchicalSummary DS comprises a HighlightLevel DS that comprises at least one 
HighlightSegment DS, the HighlightSegment DS describes information on a highlight segment 
corresponding to one of a plurality of video summary intervals, and the HighlightSegment DS 
further comprises a VideoSegmentLocator DS describing time information or a video itself of the 
highlight segment and an ImageLocator DS describing a representative frame of the highlight 
segment. 

18. (Currently Amended) A method for generating video summary description 
data according to a video summary description scheme by inputting original video, comprising: 

(a) analyzing the input original video and producing video analysis result; 

(b) defining a summary rule for selecting the video summary interval; 

(c) selecting the video summary interval capable of summarizing video contents 
from the original video based on the original video analysis result and the summary rule and 
constituting video summary interval information; 

(d) extracting a representative frame based on the video summary interval 
inforaiation; and 

(e) generating video summary description data according to the 
HierarchicalSummary DS enabling to execute execution of hierarchical browsing based on the 
video summary interval information and the representative frame, 

wherein the HeirarchicalSummary DS comprises a HighlightLevel DS that 
comprises at least one HighlightSegment DS, and the HighlightSegment DS describes information 
on a highlight segment corresponding to one of a plurality of video summary intervals, and the 
HighHghtSegment DS comprises a VideoSegmentLocator DS describing time information or a 
video itself of the highlight segment. 
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19. (Canceled) 

20. (Currently Amended) The method of claim 18 wherein step (a) comprises 

the steps of: 

extracting features from the input original video and outputting the types of features 
and video time interval at which those features are detected; 

detecting key events included in the original video based on the types of features 
and video time interval at which those features are detected; and 

detecting episode by dividing the original video into story flow base-on the basis of 
the detected event. 

21. -22, (Canceled) 

23. (Previously Presented) The method of claim 18 wherein the step (d) 
comprises the step of extracting a representative sound fi-om the video summary interval 
information. 

24. (Canceled) 

25. (Currently Amended) A system for generating video summary description 
data according to a video summary description scheme by inputting original video, comprising: 

video analyzing means for analyzing the original video and producing video 

analysis result; 

sunmiary rule defining means for defining the summary rule for selecting the video 
summary interval; 

video summary interval selecting means for selecting the video interval capable of 
summarizing the video contents of the original video and outputting video summary interval 
information based on the video analysis result from the video analyzing means and the summary 
rule fi-om the summary rule defining means; 
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representative fi-ame extracting means for outputting a representative fi-ame 

representing video summary interval based on the video summary interval information fi-om the 
video summary interval selecting means; and 

video summary describing means for generating video summary description data 

with HierarchicalSummary DS by inputting the video summary interval information from the video 
summary interval selecting means and the representative fi-ame information fi-om the 
representative frame extracting means, 

wherein the HierarchicalSummary DS comprises a HighlightLevel DS that 
comprises at least one HighlightSegment DS, and the HighlightSegment DS describes information 
on segment information corresponding to one of a plurality of video summary intervals, and the 
HighlightSegment DS comprises a VideoSegmentLocator DS describing time information or a 
video itself of the highlight segment and an ImageLocator DS describing a representative frame of 
the highlight segment , the HierarchicalSummary DS providing direct access to content of tlie 
original video through the representative frame information , 

26. (Canceled) 

27. (Previously Presented) The system of claim 25 wherein said video 
analyzing means comprises: 

feature extracting means for extracting features from the original video and 
producing the types of features and video time interval at which those features are detected; 

event detecting means for detecting key events included in the original video by 
inputting the types of features and video time interval at which those features are detected; and 

episode detecting means for detecting episode by dividing the original video into 
story flow base on the basis of said detected event. 

28. -29, (Canceled) 

30. (Previously Presented) The system of claim 25, the system further 
comprises representative sound extracting means for extracting a representative sound by inputting 
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the video summary interval information and providing the extracted representative sound to the 
video summary describing means. 

3 1.-32. (Canceled) 

33. (Previously Presented) The method of claim 18 wherein the 
HighlightSegment DS further comprises an ImageLocator DS describing a representative frame of 
the highlight segment. 

34. (Previously Presented) The method of claim 18 wherein the 
HighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

35. (Previously Presented) The method of claim 18 wherein the 
HighlightSegment DS further comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment. 

36. (Previously Presented) The method of claim 18 wherein the 
HierarchicalSummary DS further includes SunmiaryThemeList DS enumerating the event or 
subject comprised in the summary and enabling user's to execute summarizing and browsing based 
on the event. 

37. (Previously Presented) The method of claim 36 wherein the 
SummaryThemeList DS includes arbitrary number of SummaryThemes as elements, and the 
SummaryTheme includes an attribute of ID representing the corresponding event or subject. 

38. (Previously Presented) The method of claim 37 wherein the 
SummaryTheme further includes an attribute of parentID describing the ID of the event or subject 
of the upper level. 
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39. (Previously Presented) The method of 37 wherein the HighlightLevel DS 
includes an attribute of themelDs describing attribute of the ID, when the HighlightSegments or 
HighlightLevels which are constituting corresponding highlight level have common events or 
subjects, the ID of the common events or the subjects is described in the themelD. 

40. (Previously Presented) The method of claim 37 wherein the 
HighlightSegment DS includes an attribute of themelDs describing the event or subject of the 
highlight segment using the attribute of ID described in the SummaryThemeList DS. 

41. (Previously Presented) The system of claim 25 wherein the 
HighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

42. (Previously Presented) The system of claim 25 wherein the 
HighlightSegment DS further comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment. 

43. (Previously Presented) The system of claim 25 wherein the 
HierarchicalSummary DS further includes SummaryThemeList DS enumerating the event or 
subject comprised in the sunraiary and enabling user's to execute summarizing and browsing based 
on the event. 

44. (Currently Amended) An apparatus for browsing video summary 
description data, wherein the video summary description data has a HierarchicalSummary 
Description Scheme (DS) for describing a video summary from an original video , the 
HierarchicalSummary DS includes: a HighlightLevel DS which comprises at least one 
HighlightSegment DS describing information on highlight segment corresponding one of video 
summary intervals, and a SummaryThemeList DS enumerating the event or subject comprised in 
the summary and enabling user's to execute summarizing and browsing based on the event, 
wherein the HighlightSegment DS includes a VideoSegmentLocator DS describing time 
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information or video itself of the highlight segment, and an ImageLocator DS describing a 
representative frame of the highlight segment, wherein the browsing apparatus comprising: 

a video playing part for playing an original video or the video summary; 

an original video representative frame part for playing a representative frame of the 

original video; 

a first video summary representative frame part for playing a first summary level of 

video interval, 

a second video summary representative frame part for playing a second summary 
level of video interval, wherein the second summary level is summarized more finely than the first 
summary level; 

a level selecting part for selecting the first summary level or the second summary 
level thereby enabling the video playing part to play the selected summary level; a^d 

an event selecting part for enumerating the event or the subject provided in the 
SummaryThemeList DS for a user to browse desired event : and 

a direct access part to provide direct access to the contents of the original video 
througli the original video representative frame part when playing the first summary level of video 
interval or the second summary level of video interv^aL 

45. (Previously Presented) The apparatus of claim 44 wherein the first video 
sunmiary representative frame part plays the first summary level of sound information, and the 
second video summary representative frame part plays the first summary level of sound 
information. 

46. (Previously Presented) The apparatus of claim 45 wherein the 
HighlightSegment DS fiirther comprises: 

a SoundLocator DS describing a representative sound information of the highlight 

segment; and 

an AudioSegmentLocator DS describing the audio segment information constituting 
an audio summary of the highlight segment. 
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47. (Currently Amended) A method of browsing video summary description 
data and accessing original video , wherein the video summary description data having a 
HierarchicalSummary Description Scheme (DS) for describing a video summary, 

wher e in the HierarchicalSummary DS eoiBprises having a HighlightLevel DS which 
comprises at least one HighlightSegment DS describing information on highlight segment 
corresponding one of video summary intervals, and 

wherein the HighlightSegment DS comprises having a VideoSegmentLocator DS 
describing time information or video itself of the highlight segment, and an ImageLocator DS 
describing a representative frame of the highlight segment, 

wherein the browsing method comprises comprising : 

(a) playing a first summary level of video summary; a^d 

(b) playing a__video interval of tlie original video corresponding to the 
representative firame when a desired scene is found through the video summary representative 
frame at the step (a) : and 

(c) directly accessing the original video through the video summary 
representative frame when playing the first summary level of video summary or when playing the 
video interval of the original video corresponding to the representative fi-ame . 

48. (Previously Presented) The method of claim 47, further comprising: 

(c) playing a second summary level of video summary when a desired scene is 
not found through the video summary representative fi-ame at the step (a), wherein the second 
summary level is summarized more finely than the first summary level. 

49. (Previously Presented) The method of claim 47 wherein the 
HighlightSegment DS further comprises a SoundLocator DS describing a representative sound 
information of the highlight segment, the step (b) comprising the step of recognizing the desired 
scene to be found at the step (a) through the video summary representative sound information. 

50. (Previously Presented) The method of claim 47 wherein the 
HierarchicalSummary DS further includes SummaryThemeList DS enumerating the event or 
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subject comprised in the summary and enabling user's to execute summarizing and browsing based 
on the event. 

51. (Currently Amended) A Video Summary Description Scheme (DS) for 
describing a video summary of an original video , comprising: 

at least one HighlightSegment DS describing information on a_highlight segment 
corresponding to at least one ef-video sununary intervals interval , wherein the HighlightSegment 
DS comprises a VideoSegmentLocator DS describing time information or video itself of the 
highlight segment and an ImageLocator DS describing a representative frame of the highlight 
segment : the HighlightSegment DS providing direct access to the original video through the 
representative frame . 

52. (Previously Presented) The Video Summary DS of claim 51 wherein the 
HighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

53. (Previously Presented) The Video Summary DS of claim 51 wherein the 
HighlightSegment DS further comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment. 

54. (Currently Amended) A method of browsing video summary description 
data wherein of an original video, the video summary description data having at least one 
HighlightSegment DS describing information on a_highlight segment corresponding to one of a 
plurality of video summary intervals, wherein the HighlightSegment DS comprises including a 
VideoSegmentLocator DS describing time information or video itself of the highlight segment and 
an ImageLocator DS describing a representative frame of the highlight segment, 

wherein the browsing method comprising: 

(a) playing a first sunmiary level of the video summary; and 
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(b) playing a_video interval of the original video corresponding to the representative 
frame when a desired scene is found through the video summary representative frame at the step 
fa) : and 

(c) directly accessing the contents of the original \ddeo when playing the first summary 
level of the video summary or playing the video intei-val of the original \ddeo . 

55. (Previously Presented) The method of claim 54 further comprising: 

(c) playing a second summary level of video summary when a desired scene is not 
found through the video summary representative frame at the step (a), wherein the second 
summary level is summarized more finely than the first summary level . 

56. (Previously Presented) The method of claim 54 wherein the 
Highlights egment DS further comprises a SoundLocator DS describing a representative sound 
information of the highlight segment, the step (b) comprising the step of recognizing the desired 
scene to be found at the step (a) through the video summary representative sound information. 

57. (New) The method of claim 54, wherein directly accessing comprises 
directly accessing the contents of the original video through the representative frame. 
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